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Commercial Systems Validation Laboratory (CSVL) 

Stennis Space Center 


VIRTUAL PRODUC 


Validate Critical Sensors 

• Baseline Performance in 
Controlled Environment 

• Define Process For 
Sensor Truth Set 


jamst Controlled 
agery In-flight 
oss-Validate Systei 









Virtual Product Laboratory (VPL) 



Stennis Space Center 


Capabilities: 

• Physics-based System Performance 
Simulation (UV-LWIR) 

• Physics-based Image Generation 
. Atmospheric Modeling 

• Subsystem Compatibility Assessment 

• Mission Planning 

• Sensor Data Base 

• Platform Data Base 

• Remote Sensing System Trades Analysis 


Sensor Performance Evaluations 


VPL MTF Calculations 
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VPL Modules 


Stennis Space Center 


Knowledge Base 

- Oracle-based database providing access to remote sensing industry-related 
information, products, and services 

Design and Analysis 

- Mission definition 

- Compatibility assessment 

- Orbit Modeling 

- Engineering trades and optimization 

Data Simulation 

- Physics based approach 

» Scene generation 
» Sensor simulation 

- Assess instrument design, performance, and error budgets 

- Sensor types 

» High spatial resolution 
» Multispectral 
» Hyperspectral 
» Thermal 


Scene Generation 


Stennis Space Center 



• Existing imagery 

- Utilize data acquired by real sensors 

- Resample data to system characteristics 

• Synthetic scene generation 

- Software tools 

» Global Change Initiative (GCI) Tool Kit 

• Photon Research Associates, Inc. 

• rasterized models of terrain and clouds 

• atmospheric radiative transfer modeling using MOSART 

» Digital Imaging and Remote Sensing Image Generation (DIRSIG) 

• Prof. John Schott, Rochester Institute of Technology 

• high-resolution, facetized models of terrain and 3D objects 

• atmospheric radiative transfer modeling using MODTRAN 

» Custom software 

• high-resolution 2D models -- edge target, radial target 

• atmospheric radiative transfer modeling using MODTRAN 

- Scene databases/Target models 

- Atmospheric radiative transfer models 

- Observational parameters 
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Synthetic Image Simulation 


Stennis Space Center 
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Simulated output 
image includes sensor 
and orbit-induced 

SSC V&V Targets: Synthetic scene with effects. 

• 80m x 80m x 70m 8:1 contrast ratio 10-cm GSD. 
edge targets 

• 35m x 40m 4-step gray scale 
targets 

• 130m radial target 


Simulated Verification and Validation Target 

Stermis Space Center 



Spatial Oversampling 


Stennis Space Center 


jEdqe responseh 


Simulated image 


Edge target is used to derive 
edge response and 
line spread function: 
significant oversampling is 
required for proper rendering. 
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Target Simulation Spectral Radiance Comparison 

Stennis Space Center 
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Sensor Simulation 


Stennis Space Center 



• Input scene convolved with sensor PSF 

- Spatial sampling of input scene must be significantly higher (7 
to 15 times) than the sampling of output image 

• Point spread function (PSF) derived from OTF using an 
inverse Fourier transform 

• Based on Optical Transfer Functions (OTFs) 

- Model sensor spatial response 

- Include modulation transfer functions (MTFs) and phase 
transfer functions 

» Optical diffraction, optical aberrations, detector size, linear 
motion, random and sinusoidal jitter, low pass filter electronics, 
atmospheric turbulence 
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Electronic and photon noise can be applied to resultant 
image 


Modulation Transfer Function 



Sensor Modeling 

i Stennis Space Center 


Optical Transfer Function: 


Detector size 
Diffraction 
Linear motion 
Random jitter 
Atmospheric turbulence 
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Signal-to 
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(dominated by 

atmospheric 

radiance) 


Water 
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se Ratio 
Example 


Stennis Space Center 
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Commercial Instrument Validation 
Laboratory Activities 


Stennis Space Center 




Validation & Verification 

- Ground Truth & Atmospheric Instrumental 

- Next Generation Field Calibration Targets 
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Sensor Validation for Scientific 
Data Buy 


NASA VPL 

- Provide Realistic 
Inputs for 
Simulation 


Characterization p 

Multispectral Whiskbroom 
Digital Framing Camera 
Hyperspectral Pushbroom J 


Workforce Development 

1 - University Collaboration 

- Tech Transfer 


Commerce Initiative 


Design Consultation 

:: 


- Support the Development of Inexpensive Method; 
for Calibrating Commercial Airborne Remote 
Sensing Instruments 
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Commercial Instrument Validation Laboratory (CIVL) 

Stennis Space Center 


Capabilities: 

• ATLAS / CAMS sensors for airborne multispectral imaging 

• System & component level spectral {350-1 OOOOnm) and spatial (MTF & 
PSF) characterization (350-1600 nm) 

• Radiance standards (250-1600 nm) 

• ASD & GER field spectroradiometers 

• Optical system design, modeling and performance prediction 

• Dielectric filter design 

• Advanced target design 


Atlas PVT 


Sensor design trades 





Airborne Terrestrial Applications Sensor (ATLAS) 

i ' Stennis Space Center 



Calibration 

Thermal: Blackbody (2) 

VIS/NIR: Integrating Sphere 


Recording 
Digital Recorder: 

Throughput: 

Storage Capacity: 
Interface: 

Digitization: 

Video Words: 
Housekeeping Words: 


8mm tape drive, 
Helical Scan type 
500 KB/sec max 
5 GB/tape 

opoi 

8 bit (0-255) 
643/scanline 
200 max 


Spectral 

Spectral Range: 0.45 - 12.2pm 

Number of Channels: 1 4 

Detectors: Ch. 1-6, Silicon 

Ch. 7-8, InSb (LN 2 Cooled) 

Ch. 10-15, HgCdTe (LN 2 Cooled) 


Spectral Coverage: 
VISNIR 

Ch. 1: 0.45-0.52 pm 
Ch. 2: 0.52-0.60 pm 
Ch. 3: 0.60-0.63 |Lim 
Ch. 4: 0.63-0.69 pm 
Ch. 5: 0.69-0.76 pm 
Ch. 6: 0.76-0.90 pm 

SWIR 

Ch. 7: 1.55-1.75 pm 
Ch. 8: 2.08-2.35 pm 
Ch. 9: Removed 


TIR 

Ch. 10: 8.20-8.60 pm 
Ch. 11: 8.60-9.0 pm 
Ch. 12: 9.0-9.40 pm 
Ch. 13: 9.60-10.2 pm 
Ch. 14: 10.2-11.2 pm 
Ch. 15: 11.2012.2 pm 


Spatial 

FOV: 72° IFOV: 2.0 mrads 

Pixels/Line: 640 ground scene and 3 calibration source pixels 
Scan Speed: 6-50 scans/second 

Ground Resolution: 2.5-25 m 


Geometric 

GPS: 

GPS Accuracy: 

Nav. System: 
Gyro Accuracy: 
Roll Correction: 


Trimble 4000SSE 
1 .5 RMS (corrected) 
+/=100m (uncorrected) 
Trimble 2101 (GPS Based) 
0.4° 

+/- 15 0 



Channel 3 Response 


Airborne Sensor Lab Characterization 


Cross Track Scanners PVT 

Spectral 

Radiometric 

Spatial 

MTF 

VNIR CCD Cameras 

Spectral 

Radiometric 

Spatial 

MTF 

Pushbroom Hyperspectral 
Imagers 

Spectral ATL 
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ATLAS Performance Verification 
Test ( PVT) system performs 
radiometric, spectral and spatial 
resolution 

baseline measurements of 
whiskbroom scanners 


ATLAS Channel 5 MTF 
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Stennis Space Center 


Framing CCD Camera Radiometric Characterization 

— — Stennis Space Center 





ASD characterization of 
radiance sources 


Linearity Measurements 




Framing CCD Camera 



tennis Space Center 


Monochromatic Uniform Source 


Multispectral CCD Camera Response 








Monochrometer illuminates 3” integrating sphere 
Provides monochrometer input for wide field of view imagers 
- Long integration time offsets low-signal levels 
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MTF 



Framing CCD Camera MTF Measurement 

in- - 7 ^ Stennis Space Center 

Edge Response 





Optronics 12” 

Integrating 

Sphere 


Knife-edge 
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MTF estimation using tilted edge uniformly 
illuminated with a integrating sphere and 
12” off-axis parabolic collimator 
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Spectral Calibration of Hyperspectral Sensors in the 


Stennis Space Center 


Approach: 

• Several laser beams (each monochromatic, but with a different 
wavelength) are scattered inside an integrating sphere and 
illuminate uniformly the field-of-view of the tested sensor. 

• The integrating sphere becomes a light source with sharp 
spectral features that allow for spectral calibration of the 
sensor. 

• By using lasers, the technique circumvents problems of an 
insufficient signal from filtered light sources. 
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Spectral calibration of Hyperspectral Sensors in the 


egression analysis performed for each spatial pixel 


slit2x2 Ian 0 (mean frame) 



Stennis Space Center 
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Spatial dimension 


Possible improvement (in works): wider spectral 
range covered by lasers (tunable lasers / laser 
diodes, IR lasers) 








/ Spectral Calibration of Hyperspectral Sensors in the 
Laboratory 


Stennis Space Center 


Spectral sampling intervals 
calculated for each spatial pixel: 
dependent on pixel position 




Detected a geometric 
distortion of the spectra: 
“smile” effect at center 
(edge -- gaussian) 
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Calibration of Hyperspectral Sensors at CIVL 

Stennis Space Center 
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Ground Reference Equipment Characterization 

i Stennis Space Center 


Spectroradiometers 

• Spectral 

• Radiometric 

Linearity 
Radiance 
Dark Counts 
Drifts 

• Reflectance 

• FOV 

Infrared Radiometers 

• Calibration 

• Time Response 

• FOV 

• NEDT 

Goniometer 

• Spectroradiometer 

• BRDF 


Ground Truthing Instrumentation 



Spectral 
Reflectance 
of SSC Grayscale 
Targets 
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In-Flight Verification and Validation 

Stennis Space Center 


System Performance Validation 

Establish traceability from the information used by decision 
makers , back through the remote sensing image chain, to what is 
actually happening on the ground. 


SSC Large Verification Targets 
Full-Field-of-View Geodetic Target 
Range 

Atmospheric Measurement System 

Spectral and Bi-directional 

Reflectance Measurement 

Instruments 

Thermal Measurement 

Instrumentation 

Algorithm Validation Process 

Data Validation Process 

Data Collection, Management, and 

Dissemination System 

Interagency Collaboration 
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Stennis Space Center 
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Sandmeier Field 
Goniometer for Bi 
directional 
Reflectance 
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Rooftop Contact 
Surface 
Temperature 
Sensors 


Water Surface 
Temperature 
Sensor 


Elastic 
Backscatter 
Micropulse Lidar 


Total 

Sky 
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Ground Reference Information Team 


Stennis Space Center 


Provides comprehensive ground support services for a wide variety of remote sensing projects 


Surveying 


Spectrorad iometry 


Atmospheric Measurement 


Goniometer Spectroradiometry 




U.S. Dept, of Energy Interagency Collaboration 

Stennis Space Center 

Multispectral Thermal Imager (MTI) Temperature Project 
Objectives 

• Expand current V&V activities to include thermal infrared to support commercial, 
ESE and other government multispectral thermal validation programs (MTI, 

ASTER, ATLAS, TIMS) 

- Characterize and instrument SSC thermal validation targets 

» Water bodies - HPIW Reservoir 
» Man-made flat solid surfaces- Rooftop of building 1103 

- Develop a SAA with the Multispectral Thermal Imager (MTI) Program Office through 
the DOE Savannah River Technical Center (SRTC) to assist in validating MTI 
imagery 

Motivation 

• Foster commercial applications of radiometric thermal sensing and physics 

• Opportunity to validate upgraded ATLAS through vicarious calibration 

• Opportunity to fuse multispectral thermal with multispectral reflective data for 
improved material classification 

• Opportunity to further define future ESE mission requirements 
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Multispectral Thermal Imager (MTI) 

— Stennis Space Center 


• DOE funded 

- Sandia National Laboratories Systems Integrator 

• Pushbroom System 

- Cryogenic FPAS VIS-LWIR 

» 75 deg Kelvin Cold Finger 
» 3 chip assembly 

- 15 bands 
-5m GSD VIS 

- 20 m GSD SWIR-LWIR 

- 1 2 km swath 

• Off-nadir pointing while imaging 

- +/- 50 deg pitch 

- +/- 20 deg roll 
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MTI Band Heritage 


Stennis Space Center 
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Temperature Project Technical Approach 

Stennis Space Center 


• Characterize the High Pressure Industrial Water (HPIW) Reservoir 

— Model thermal radiative transport physics 
— Calibrate required instruments with black bodies in the Lab 

- Measure thermal radiation independently with multiple instruments 
— Compare measurements with model predictions 

• Develop a floating measurement system to support water body 
ground truthing activities 

- Evaluate MTL Data Acquisition Float (DAF) 

- Assist DOE/SRTC in evaluating their measurement float 

- Design, build, test and field an SSC measurement float 
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Thermal Modeling 


Stennis Space Center 


Monochromatic Radiative Transfer Equation 



Thermal Modeling 



Stennis Space Center 

Monochromatic Radiative Transfer Equation 

R(X) = e{X)B(X,T s )T a , m (X) + (\-e{X))S l (X)T am +s\X) (i> 

Where: 

x = Wavelength [jum] 


Emissivity of surface 

Downwelling Radiation (sky emission) striking water 


w 

2 

cm sr 


s f (A) = Atmospheric Radiation between water surface and sensor 
T atm W= Atmospheric Transmission between water surface and sensor 


w 

cm 2 sr 


r = Angle of incidence, 15° 


T s = Skin Temperature 
R(h) = Radiance at sensor 
B(h,T s )= Plank function 


[°K] 

W 

cm 1 srjjm 
W 

cm 2 srjLim 
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Instrument Calibration 


Stennis Space Center 



Radiometer Characterization 


Heimann Temperature Calibration 
Time Constant Measurements 
NEDT 

Field of View Measurements 
Warm-up Characteristics 
Spectral Response 
Ambient Temperature Effects 



Azonix RTD thermometer 

I Corje blackbody 
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Instrument Calibration 


Stennis Space Center 



Heimann Radiometer Temperature Calibration 


RadiometerPolynomial Ramps Vs Waterbath Temperature 



Polynomial expression: 

Tb=0.0004T r A 2+1 .001 6T r-0.6466 
Where Tb=Brightness Temperature 
Tr=Radiometer Output Temperature 
Method: 

Use the polynomial expression 
as a correction to radiometer 
readings. 


Example: 

Hiemann average reading: 28.3663 °C 
Waterbath temperature: 28.028 °C 
Polynomial corrected value: 28.0033 °C 


RadiometenPolynomial Ramps Vs Waterbath Temperature 
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SSC HPIW Reservoir Thermal Characterization 

Ground Truthina 


Stennis Space Center 


Weather Station 


Radiosonde Launch 


SSC Measurement Float 


In Situ Thermal Imagers 
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Stennis CRSP Measurement Float 


Stennis Space Center 


Heimann 

Radiometer 


Windspeed/wind direction 


r Temp Sensor 
humidity 


Electronics 









HPIW Reservoir ATLAS Thermal Imagery 


Stennis Space Center 


Synthesi, 




(Blurred & 
Resampled) 


Temperature °C 



IR Camera HPIW Reservoir Imagery of CRSP Float 


Stennis Space Center 



Float does not influence surrounding water where 
radiometer measurements are taken. 
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Temperature 


SSC Float Measurements 



10cm 


50cm 


33.5 


Time of Day 


Temperature Profile 


Stennis Space Center 


Average Water Skin Temperature 


32.5 I 


31.5 1 


30.5 


WIND SPEED 1.3 M/S 


AIR TEMP 34.51° 
HUMIDITY 44.21% 


33.33 


Pump Fountain 


SKIN TEMP 


A Skin to 2.5cm= 0.7 


2.5c 


1 0cm ~ 


SOcifi 
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12 : 10:00 

12 : 25:00 


Water Depth 




Stennis Space Center 



Scientific Data Purchase 
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Science Data Purchase Data Providers 

— Stennis Space Center 


• EarthSat 

- Landsat Orthorectified Imagery 

• Intermap 

- Star3l Interferometric SAR 

• Positive Systems 

- ADAR 5500 

• Space Imaging 

- IKONOS 
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Earthsat - Scientific Data Purchase Program 


Data Description 

• Global coverage of orthorectified Landsat 
MSS and TM imagery over 2 time periods 

— MSS Scenes - from 1970s, 20% or less cloud 
cover, +/- 100m horizontal PA (90% Cl) 

— TM Scenes - from late 1980s to early 1990s, 
20% or less cloud cover, +/- 50m HPA 

(90% Cl) 

- TM Mosaics - compressed RGBs of bands 
7,4, and 2, each mosaic corresponding to 
large region, formatted as MrSID files 

Data Rights 

• For all data 10 years and older, distribution 
unlimited within NASA ESE community for 
NASA related work 

Area of Coverage 

• MSS - 233 Scenes 

• TM - 2825 Scenes 

• Mosaics - 103 Data Sets 


Stennis Space Center 
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1990 Landsat Thematic Mapper Scene 
of Yellowstone National Park 
Acquired via the “Data Buy” 




Space Imaging- Scientific Data Purchase Program 

stennis Space Center 


Data Description 

• IKONOS-2 Satellite Imagery 

- 1 meter resolution panchromatic imagery 

- 4 meter resolution multispectral imagery 

• "Original Data" - rectified to constant 
elevation 

• "Master Data" - orthorectified imagery 

• "Model Product" - DEM's and stereo pairs 

Data Rights 

• Distribution unlimited within ESE 
community 

• Derived products may be distributed within 
NASA science/ research community 

Area of Coverage 

• Original - 72,000 Sq.. Km 

• Master - 23,000 Sq.. Km coverage 

• Model - 70 scenes @11 km X 1 1 km 
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IKONOS four meter multispectral image 
of South Bay San Francisco, California 




Earthwatch - Scientific Data Purchase Program 

~ i Trr~ Stennis Space Center 


Data Description 

• STAR3i Airborne X Band Radar Products 

- 5-10 meter IFSAR DEM data 

- 2.5 meter resolution orthorectified SAR 
image map imagery 

• GT-1 DEMs - 5m posting, +/- 1m RMSE vertical 
PA, +/- 2.5m RMSE horizontal PA 

• GT-2 DEMs -10m posting, +/- 2m RMSE 
vertical PA, +/- 2.5m RMSE horizontal PA 

• GT-3 DEMs - 10m posting, +/- 3m RMSE 
vertical PA, +/- 2.5m RMSE horizontal PA 

Data Rights 

• Distribution unlimited within NASA ESE 
community for NASA related work 

Area of Coverage 

• Total Coverage 99635 sq... km as of 6/1/2000 
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3-D Oblique Views of 
Star3i Data Products 
Over Washington, D.C. 



Positive Systems - Scientific Data Purchase Program 


Data Description 

• ADAR 5500 Multispectral Data 

- IM-R1 i-55 - 1 m 8 bit MS data with post- 
flight radiometric corrections, band to band 
co-registration within +/- 1 pixel, contains 
blue, green, red, and NIR bands, absolute 
radiometric accuracy within +/- 10% 

- MOS-G1 - 1m 8 bit MS mosaics with <= +/- 
12.2m horizontal PA for benign terrain, <= 
+/- 33m HPA for rugged terrain, and <= +/- 
50m HPA for extreme terrain 

Data Rights 

• Distribution unlimited within NASA ESE 
community for NASA related work, 
providing acknowledgement of data 
provider is given in publications and 
products utilizing the data 

Area of Coverage 

• 7858.8 sq.. km of imagery 

• 793.2 sq. km of image mosaics 


Stennis Space Center 




1997 Positive Systems ADAR 5500 Image 
Mosaic of Ship Island, Mississippi 
Draped over Landsat TM Image 
Inset of Fort Massachusetts 



Space Imaging IKONOS - Data Validation 

~~ — — rrijili ' — •= Stennis Space Center 


ImGSD PAN 


4m GSD MS 



Quantitative System * and spatial resolution 
Characterizations: • Geometric properties of imagery 

• SNR estimates 

• Band-to-band registration of multispectral products 

• Radiometric accuracies of products 

• Intercomparison of IKONOS, Landsat 7 and other 
satellite imagery 

• NIIRS rating of products 
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Interagency Commercial System Validation 

— - - — Stennis Space Center 


Joint NASA / NIMA / USGS team 
focused on characterizing commercial 
remote sensing system performances 

Overall performance assessment to 
meet each agency’s mission 
requirements 

- NASA - Systems Characterization 

- NIMA- Photogrammetry 

- USGS - Cartographic Assessment 

Improved communications with 
industry 

- More productive interchanges between 
industry and government 

- Minimize duplication of effort 

- Reduction in costs incurred by industry 
and government 



IKONOS one meter panchromatic image of 
Jefferson Memorial in Washington, D.C. 
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SDP IKONOS Characterization Team 

m I i ummnm^ "i liiiiiii SteiWiS Space Center 
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SDP Characterization Activities 


Stennis Space Center 



WwM 

Characterization 

(All acquired data sets) 




• Meta File 
> Location / Coverage 

• Cloud Cover 
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standard deviation 



Performance P 

Characterization 

(Sample V&V data sets) 


• Positional Accuracy 
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Applications Utility 

m^rn m 

• University of Maryla 
assessment 

• Exploit core sites 




• Obtain feedback from 
| ESE researchers 
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Performance 
Characterization 



